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Real-World HDR Lighting Environments 


Funston 


Uffizi 

Gallery 


Eucalyptus 
Grove 


f ' ^ 


Grace 

Cathedral 


Lighting Environments from the Light Probe Image Gallery: 
http: //v/v/v/. debevec. org/Probes/ 


rj/erence 

Illuminating Objects using 
Measurements of Real Light 



Light 


Environment 
assigned "glow” 
material 
property in 
Greg Ward’s 
RADIANCE 
system. 


http : / / radsite . Ibl. gov/ radiance/ 
http://www.debevec.org/CGAIBL/ 



Corjfsr&ncs 

Elements of HDRI and IBL 



High Dynamic Range (HDR) Images 

1 •- 


Pixels beyond 0-255 

• 


Pixel proportional to light levels 





Light Probe Images 



Omnidirectional HDR images, or 

f 


HDR environment maps 



Global Illumination 

TT 


Illuminating CG objects with 



images of incident illumination 
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I.Gc<iweD£velQper5».- - 


Confsrsncs 

IBL Tutorial 

Image-Based 

Lighting 

In Jan/Feb 

Computer Graphics 


and Applications 


and the SIGGRAPH 
2002 IBL Course 


Notes 


www.debevec.org 



Dynamic Range in the Real 
World 


Office interior 

Indireet light from 
window 

1/60* see shutter 
f/5.6 aperture 
0 ND filters 
OdB gain 


Sony VX2000 video eamera 



MANUAL 

60 


"“ 'Dynamic Range in the Real 
World 

Outside in the shade 
1/1000* see shutter 
f/5.6 aperture 
0 ND filters 
OdB gain 

1 6 times the light as inside 




0 ND filters 


MANUAL 

'1000 


Dynamic Range in the Real 
World 


Outside in the sun 
1/1000* see shutter 
f/1 1 aperture 


OdB gain 


64 times the light as inside 


"“ 'Dynamic Range in the Real 
World 

Straight at the sun 
1/10,000* see shutter 
f/11 aperture 
13 stops ND filters 
OdB gain 


5,000,000 times the light as inside 


MANUAL 
10000 AWB 
F11 OdB 


mmrnsmmmmmmmmmmmm 

“' Dynamic Range in the Real 
World 

Very dim room 
1/4* see shutter 
f/1. 6 aperture 
0 stops ND filters 
18dB gain 

1/1500* the light than inside 
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2,000,000,000 


Dynamic Range 
in the Real 
World 



High-Dynamic Range Photography 


f- r 



W/sr/m2 

121.741 - 

28.869 

6.846 

1.623 

p.384 

b.091 

b.021 

0.005 


Debevec and Malik, Recovering High 
Dynamic Range Radiance Maps from 
Photographs, SIGGRAPH 97 


300,000 : 1 

Visualization: Greg Ward 


H D R Shop 

High Dynamic Range Image Processing and Manipulation 



www.debevec.org/HDRShop 

Introduction | Tutorials | Reference | Plugins | FAQ | Download/Licensing | WWW Links | Mailing List 

Chris Tchou and Paul Debevec. HDR Shop. SIGGRAPH 2001 Technical Sketch 



Conference 

DirectX 9 HDR Data Formats 

32-bit floating point textures 

• D3DFMT_A32B32G32R32F / D3DFMT_R32F 

• IEEE compatible 

16-bit floating point textures 

• D3DFMT_A16B16G16R16F 

• saves memory bandwidth 

• often sufficient dynamic range and 
precision 



HDR Image File Formats 


2004 Game Developer’s Conference 


3 










“High Dynamic Range Lighting” March 24, 2004 

Paul Debevec, USC Institute for Creative Technologies 


HDR Formats; RADIANCE Format 
(.pic, .hdr) 

Greg Ward’s “Real Pixels” format 
32 bits / pixel 


Red 


Green 


Blue 


Exponent 


(145,215, 87, 149) = 
(145, 215, 87) * 2^(149-128) = 
(1190000, 1760000,713000) 


(145,215, 87, 103) = 
(145,215, 87) * 2'^(103-128) = 

( 1.00000^ TZ, 0.00000641, 0.00000259) 


Ward, Greg. "Real Pixels," in Graphics Gems IV, edited by James Arvo, Academic Press, 1994 


HDR Formats: Portable FloatMap (.pfm) 
12 bytes per pixel, 4 for each channel 


sign exponent 


mantissa 


Text header similar to Jeff Poskanzer’s .ppm 
image format: 


768 512 
1 

<binary image data> 


Floating Point TIFF similar 


Conference 

HDR Formats; ILM’s OpenEXR (.exr) 

6 bytes per pixel, 2 for each channel, compressed 



sign exponent mantissa 

• Several lossless compression options, 2:1 typical 

• Compatible with the "half” datatype in NVidia's Cg 

• Supported natively on GeForce FX and Quadro FX 

• Available at: http://www.openexr.net/ 




HDR Formats: Ward’s LogLuv TIFF 

based on human color perception 



24 bits: 10 for log luminanee 

14 for ehromatieity index 
32 bits: 15 log luminanee 
8 u ehrominanee 
8 V ehrominanee 
1 sign 


Larson, G.W., "Overcoming Gamut and Dynamic Range Limitations 
in Digital Images,” Proceedings of the Sixth Color Imaging 
Conference, November 1998. 

http://positron.cs.berkeley.edu/~gwlarson/pixformat/tiffluv.html 


lorifsfsrjce 


Panoramic (Omnidirectional) 
Photography 


Light Probe Images: 
Capturing Real-World Illumination 


't. \ 

r 

r -v ' 


f 





. ■>- 




other techniques: 

- Panoramic Stitching (Realviz Stitcher) 

- Fisheye Images 

- Scanning Panoramic Cameras 

(Panoscan, Spheron) 
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HDR Rendering Process 


Scene 

Geometry ^ 
lit with 
HDR Light^ 
Probes 





Building the Scene 


• Render reflected scene into HDR planar 
reflection map for table top 

• HDR light probe for distant environment 

• HDR environment maps for local 
reflections from balls on pedestals 

• Postprocess to get glows 

• Tone map to displayable image 




Local Reflection 

Distant HDR Light 


probe is always 
sampled with 

100 % f 

reflection vector in 

pixel shader 

Blend 

Local environment map 
is sampled with a 

between R 
and N 

blend of the surface 
normal (N) and the 
reflection vector (/?) 

100% f 



Frame Postprocessing 



/Tt 


Va Size 
Frame 


Horizontal 

3-Gaussian 

Filters 


Vertical 3- 
Gaussian 
Filters 


• Filter 50x50 pixel region with 
sum of three Gaussians 
Gaussians are 0=2, 0=6 and ct =14 


Displayable 

Image 
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pMPnmii 


Capturing Light Probes in the Sun 



Conference 

How bright is the sun? 

Radius = 695,000 km 
Distance = 149,600,000 km 
=> 0.5323 degrees in diameter seen from earth 
= 0.00465 radians radius 
1/0.004652 = 

46,334 times 
brighter than 
"white” 
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"LightGen” by Jon Cohen et 
al. at 

www.debevec.org/HDRShop 

Supports Maya, RADIANCE, 
Mental Ray, Lightwave 


• 

• 

• • 

• 

► • • • ^ • 

• • • • • • - 

•.•••• . 

• 

• • 

• 

• 

• . . -T-l** . * 
* • • • • • 
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Structured Importance Sampling 
of Environment Maps 

Sameer Agarwal Serge Belongie 

Henrik Wann Jensen Ravi Ramamoorthi 

Importance 
Sampling 

3000 samples 

Noisy 
and slow! 




Structured Importance Sampling 
of Environment Maps 


Sameer Agarwal 
Henrik Wann Jensen 


Serge Belongie 
Ravi Ramamoorthi 


Structured 

Importance 

Sampling 

300 samples 


Conference 

Approximating 

Environments 

• :V ■ . * ^ ‘ H: 





Light Stage 1.0 



■ ^ - 1 



i 


Debevec, Hawkins, 

* 1 
_ % 1 

fi 1 

Tchou, Duiker, Sarokin, ■ 


and Sagar. Acquinn§ 
the Reflectance Field 
of a Human Face. 

SIGGRAPH 2000. 

4 ^ 

I'ii:* 
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'Modulated Images 

- t rr 


rri f r’ 

^ ^ J 1 ^ 


f ; ( . P » 

j j • j ' 

« « ? r 

tt 

T ^ 



V T. W' 





iGcfmeDjBveloDGr^^ 


Light Stage Results 




f '^1 


m 





Environments from the Light Probe Image Gallery 
www.debevec.org 


Acquiring the Reflectance Field 
I of a Human Face Lighting Demo 


Tim Hawkins 
Paul Debevec 

USC Institute for Creative Tectiriofogies 




Interactive Lighting 
Demo 

Chris Tchou, Dan Maasi' 
SIGGRAPH 2000 Creative J 
Applications Laboratory M 
www.debevec.org/FaceDemol 


% 






Env. Luminance 

I- 


Lighting Reflectance 
Functions 


r’ir:v 


II 

f 

• T 

normalized 


reflectance 

lighting 

light map 


function 

product 


X 

t r » 

rr' ' ~ 


DCT Basis 

Smith and Rowe. Compressed domain processing of JPEG-encoded images. 1996 




Real-Time IBL with Spherical 
Harmonics 



Frequency Space Environment Map Rendering 
Ravi Ramamoorthi, Pat Hanrahan, SIGGRAPH2002 

Precomputed Radiance Transfer for Real-Time Rendering 
in Dynamic, Low-Frequency Lighting Environments 
Peter-Pike Sloan, Jan Kautz, John Snyder, SIGGRAPH2002 
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iliiliippiMBaHgssa! 

Confsrencs 

Real-time IBL Techniques for 
Complex BRDFs 

Ramamoorthi and Hanrahan, 
An Efficient Representation 
for Irradiance Environment 
Maps, Siggraph 2001 . 
Ramamoorthi and Hanrahan, 
Frequency Space 
Environment Map Rendering, 
Siggraph 2002. 



( 


Real-time IBL Techniques 

■ P.-P. Sloan, J. Kautz, J. 
Snyder, Precomputed 
Radiance Transfer for 
Real-Time Rendering in 
Dynamic, Low-Frequency 
Lighting Environments, 
SIGGRAPH 2002 

Excellent Overview: 

Robin Green, Spherical Harmonic Lighting: The Gritty 
Details, GDC 2003. 



All-Frequency Shadows Using Non-linear Wavelet 
Lighting Approximation 

Ren Ng 

Stanford University 


•Approx, lighting L (EM) in (non-linear) 
wavelet basis 

• Light transport T as sparse matrix 

• B = TL (sparse matrix-vector mult.) 

• Better than spherical harmonics! 

- blurred lighting 

- soft shadows 


SH(100) Wavelets (100) 



Ravi Ramamoorthi 
Columbia University 


Pat Hanrahan 
Stanford University 


Non-linear Lighting Approximation 


All frequencies! 

2D Harr transform 
- orthonormal basis 

Weighting (error 
minimization) 

• Unweighted 

• Transport weighted 

• Area weighted 

Further investigation 
required! 

• Weighting scheme 

• Spherical wavelets 





SH (4096) W (4096) 


nl $H (10.000) Reference 


High energy lights (> lO'^) 


Low energy lights (< 10^) 




Image-Based Lighting in Fiat Lux 


Paul Debevec, Tim Hawkins, Westley Sarokin, H. P. Duiker, Christine Cheng, Tal Garfinkel, Jeimy Huang 
SIGGRAPH 99 Electronic Theater 

'^ggSS^SSSSSSiSSSSSSOtSS^S^ 
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Interior of St. Peter’s reconstructed 
from one viewpoint 


Debevec, Taylor, and Malik. Modeling and Rendering 
Architecture from Photographs. SIGGRAPH 96 



Renderings made with Radianee: http://radsite.lbl.gov/radianee/ 


Lighting Calculation 



Confsr&nce — - 

HDR Lighting Real-World Reflectance 
Properties 


Recovered Ward Model Reflectance Parameters 






d\ 



Gardner, Tchou, Hawkins, and Debevec SIGGRAPH 2003 
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The Ward Model 
with Translucency 
(Single Light Source) 


, exp -tan — 

^ ^ (n \ COS^^ cc^ 

- p,cose, + p,cos[e,+n:)-\- p^- \ ^ 

TT V COS 6',. Aa 


Note: all cosines are clamped to be non-negative 


In terms of vectors 


exp - tan 


pXt^)+p{t-^)+p,0^- 


Where: 

= cos"' dli + F|| ■ v) = cos"' {H-N) = half angle 




Interpolated / Constant Values 


pX£J}+p,(£-J}+p^J^- 


exp - tan 


HDR Texture Maps 


^ pX£J}+p,(£--j^}+p,J^- 


exp - tan 


I = light intensity 
L = light direction vector 
V = view (camera) direction vector 
H = half angle vector 


Pd = Diffuse reflectance (RGB) 

Pt = Translucent transmission (RGB) 
Ps = Specular reflectance (RGB) 
cc = Specular roughness (A) 

N = Surface normal (XYZ) 


wmmmm 


Gaussian Specular Lobe Table 


pX£-R)+p,{£-J)+p,^ 


exp 


- tan 




Stored in a texture 
map indexed by 

{a,H-N) 
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iGdiHGDovfilopGrs. 


High Dynamic Range Display System 

Emerging Technologies 

Helge Seetzen Wolfgang Stuerziinger Greg Ward 

Lome Whitehead Andrejs Vorozcovs AnyHere Consulting 

Dept, of Physics of Astronomy Dept, of Computer Science 
University of British Columbia York University 




^ ' Thanks! 


Jason Mitchell, Chris Brennan, Masaki Kawase 
Chris Tchou, Andrew Gardner, Tim Hawkins, H.P. Duiker, 
Westley Sarokin 



Sponsors: National Science Foundation, Interactive 
Pictures Corporation, Interval Research Corporation, 
the US Army, TOPPAN Printing Co. Inc., and the 
University of Southern California 

http://www.debevec.org/ 
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